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ABSTRACT 



The CEVAL simulation exercise is appropriate for use 



in a >orkshop setting with up to 30 persons. It gives 
non-administrative groups — school board members,, parent advisory 
counciljs, teachers, and parents-^experience in making evaluative 
decisions, from the perspective of a School ptincipal evaluating five 
special programs in an elementary school- The exercise, which can be 
played in 50 to 90 minutes, is designed to acq.uaint the player with 
the frustrations and rewards of evaluation, as well as the 
educational and political context in which evaluation takes place- 
This document includes instructions for the workshop trainer -and one , 
copy of each of four sets of handouts for the participants: (1) 
summary of rules and background information about the school and its 
programs; (2) report fram the evaluation consultant describing 
possible methods of evaluation; (3) assessment selection form, used 
to determine the ampunt of time devoted to different evaluation 
activities; and (4) inter district memo, which list3 eleven questions 
asked by parents about ±he effectiveness of' the basic education 
program. (Authop/GDC) 
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Trainer's Manual 

FOR 

Ceval Elementary School 

SIMULATION exercise 



GENERAL PURPOSE 

This exercise Is designed for a workshop setting for up 
to thirty persons. In addition to this Manual , the exercise 
materials consist of an audlocassette and four sets, of hand 
outs, each printed In a different color.. The Summary of 
Rules and Background Information (blue) andt the Report from 
the Evaluation Consultant (green) are^ retarn'abje. ^ Th'e 
Assessment Selection Form^( cream) and the I^nterd'lstrlct Memo 
(white) are expendable. 

This simulation^ Is designed to give non-adml ml strati ve 
groups schoyOl board .members , parent advisory cc|incns, 
teachers, and parents ^- exper1en,ce In making evaluative 
decisions In the Veal world" of the school system. It^; 
acquaints the partlclpaints with the frustrations and regards 
of evaluation, as well as the educational and political^ 
context In which most evaluation takes place. It may be" 
played in a 50 minute period or expanded to an hour and ? 
half. 



THE CASSETTE INSTRUCTIONS ^ 

The instructions for the simula,t1on are presented on 
an audlocassette tape.^ The easiest and most effective way 

for the trainer to gaif? an understanding of the simulatiqn 

Is to read the script as the cassette is playing and follow 

the instructions as they are given. The script with 

ADMINISTRATIVE INSTRUCTIONS Is presented below, followed 
by a series of clarijFyIng questions. 



MATERIALS NEEDED — IN ORDER OF USE 

7ra1 ner ' s f^anual 
Audlocassette tape 
Audlocassette Player 

Summary of Rules and Background Information 

(blue 1 eaf let-^? t'^ participant, for return 



Evaluation Consul'tant's Letter' with Accompanying keport 
• (green leaflet}' 1 per participant, for return 

Assessment Selection Form 

" (white sheet) 1 or more per table, expendable 

Interdlstrlct Memo from SupeH ntendent . 

(cream sheet) -1 per participant, expendable 

GETTING STARTED 

♦ Try to avoid .the tempta 1 1 on • to make 'everything perfectly 
clear. All required inforrnation -1 s on the tape. It 1s 
best not to try, and anticipate problems. Briefly explain' 
to the partlci pants that they are about to be Involved in a 
simulation In which they will be asked to. develop an evaluation 
plan'for an elementary school. Divide them into working grou 
of three to five persons, and start the audiocassette player. 



TIMING 

Below* is a suggested schedule for a 50'minute presentation. ^ 
If you have a'longer, period^ of time available, DO NOT Increase 
the amount of time spent in playing the game, but expand the 
discussion time. If the game playing time is expanded, it 
loses its sense of urgency. 

Minutes Action 

00-05 Arrival, divide into groups and introduction. 

05 Turn tape player on for background. 

11 Hand out bl ue Summary leaflet as Indicated. 

12 Turn off tape player as indicated. 
12-15 Participants review Summary Teafl et . 

15- 16 Turn tape player on foe Consul taot ' s, Report. 
16 . Hand out green Consultant's Report. 

16 Turn tape player off as indicated. 

16- 20 Participants rev.iew Consultant's Report. 

20 Turn tape player on for description of problem. 

21 Hand out whi te Assessment Selection Form.* 
21 Turn tape pTayer'off as indicated. 

21-40 Participants work on problem solving. 

41 Turn on tape^player for Superintendent's reque.st. 

41 Hand out cream interdlstrlct memo from superintendent 

41 Turn tape player off as indicated. 

41-45 Participants place checks by quesutions.. 

45 Discussion begins. 




^ ' ■ ,' -z- 

\ 



Script for the 
Ceval Elementary School Simulati^ Exercise 



Office noises in baakgi'v'und 
Telephone rings twice 

Of fiae' noises fade as aonvevsaiion begins 



SECRETARY: "Good morning, Ceval El ementary School . May I 

help you? (slight pause) Yes, Mrs. Jones. No, 
I'm sorry, the principal's In a meeting. May I 
leave, a message? (listens) You want Tommy taken 
out oiF the multlgrade (as though writing message) 
Yes, I'll make sure he gets It. Goodbye." 




writer starts again. 



Phone rings 



SECRETARY- "Good morning, Ceval Elementary School. Hello,. 

- Mildred, how are things in the Superintendent's 
o'^fice? (slight pause) No, he's meeting with : 
the ne.w aides. Yes, I'm suf-e he knows of the 
meeting but let me cheek his calendar. Yes, he's 
got <^t." Mr. Wilson at 3:15 at his office,. ,0K. 
Goodbye." 

NARRATOR- "Cevlil Elementary School Is located in a small 
unified school district In California. Assume 
that your group Is the principal of the s'chool , 
1 As principal you will be required to plan an 

evaluation of one or more of the special programs 
' ., in the sch-ool , prepare a report for the board of 

education using the results of your evaluation, 
and then discuss the results of -th-e simulation 
experience with the other participants.- All 
mater^ials presented on this tape will be 
summarized and handed out later, so you. need 
not take notes. ^ \ 

There are five special p>ograms in the Ceval 
, Elementary School which you may want to evaluate. 

/ To give you a feeling for why&t they are and how 

/ they are working, we've gathered significant ' 

. persons from each of these programs. Here is 

Ms. Phillips, a teacher from the 4-5-6 multlgrade. 
Ms. Phillips, exactly what is the multlgrade?" 



MS. PHILLIP^: 



NARRATOR: 
MS. PHILLIPS: 



'*Bas1caMly. the multlgrade 1s 90 k1ds and^3 
teachers. Each teacher teaches his or -he^r 
own specialty to the whole class. Jn teiPms 
of bbokkeepi ng though , each teacherlh^as /" 
responsibility for only one-third of the 
class. All three u)f us emphasize Independent 
^'study, creative tjflnklng^and Individualized 



1 pstructi on'. " 



"How Is th« multlgrade wor k1 pg ou t? " 



"Oh, 1t*s working out 
have asked that their 
but tha t ' s natural . " 



very wel 1 . 
chl 1 dren be 



A few parents 
transferred , 



NARRATOR: 



"Dx> you think multlgrade .students 
Independently and creatively than 
tradi t1 on'3^1 classes? " 



work more 
students In 



ms; phillips: 
narrator: 



I think so, I think so. 



MR. JOHNSON: 



narrator: 
mr.' johnson: 

'narrator 
mr. johnson: 



narrator: 



And Mr. Johnson also i n the /mTrrrTgrade but 
responsible for starting the ^ndl yidual ly 
Guided Mathematics Program . . . Mr Johnson', 
exactly what ts the Individually Guided' 
Mathemati cs Prograjn?" 

' ^' * ^ ' ' * > " 

"Well, It; that ' s' *hat 1< Is — It's the - 
Individually Guided Mathematics Program. 
Basically what we do Is we give each student 
a test at the beginning of the ^ear and 
determine where he or she Is and we have them 
work at their own pace and meet their own 
goals. It's much better than the old way when 
we trl^d to teach all of the students the 
same concepts at the same t^lrae. This program 
Is used only In the multlgrade but we think 
other teachers will be using It soon."* 

"Has It 'Improved your scores In the state test?' 



"Well, no I d^n't thm It has. I'm no| 
really sure but there are other advantages." 

"Like what?' 

"Students like math a lot better, they're not 
under so much pressure." 

"Thank you, Mr. JioKnson. And here's Ms. Silver, 
the Learning Cente/ Coordinator . Ms. Silver, 
how do you like working In the Learning Center?" 



Mt*s just terrific — just great. I ^ 
love It'." 

*'What happens In the Learning Center?" 

"Oh, all sorts of things, Wef have^tape 
recorders and cameras , tyjpewr 1 ters , model 
ral Iroads', rabbi ts , snakes and lizards. 
Kids come-In to work Qjn their own and In 
groups. Oh, they just, do wonderful things." 

^"Have yob experienced any prpblems wICh the 
Learning Center?" . \ 

"Oh^ some qf the teachers feel that .there 
Is a lack of disclplijie and the kids don't 
work enough, but they're juSt not used to^ 
seeing kids turned on . " 

"And now, our two parents. First Mr. Flynn, 
one of the prime movers of the Basic Educatlorv 
Program . " 

"I've prep^red^V statement, so I won't waste 
any of yoUr time or mine. Time 1s very 
valuable, you, know, and that's one of the' 
things we try to teach students In Basic 
Education class. Reading, writing, and 
arithmetic are studied to t;h^e exclusion of 
al 1 other sutject m^^^tt^r- incl udl ng art , 
social studies, health and current events. 
Discipline and formal manners are emphasized. 
Pupils stand when asking questions and shake 
hands with the teacher as th^y enter tjhe 
room. All student^S are expected tp do at 
least one hour of home work each evening. 
All are, enrolled at the parents' request. ^ 
It's a program a person can be proud of." 

"Thank you, Mr. Flynn. And Mrs. Cardova, 
past president of the Parent Advisory C^ouncil. 

"Yes, my committee helped to get the Hispanic 
reading materials In the school. Our children 
were falling way low on the reading scores 
and. their reading books d 1 dn ' t say any thi ng 
about the Chicaho culture. The Hispanic 
reading materials were developed by Dr. Garcia 
put at State. They help the students 1 earn 
how to read and use examples frorti our culture. 
Some of the parents in the new council don^t 
like them because they're only mimeoj^raphed , 
and they say the. children still asren't 
learning how to* read." '^K' 



NARRATOR: 

MRS . . CARDOVA : 



"Have the children's scores Improved?" 
I sure they ha ve . ' 



Hand out blue eummfiry while narrator ie talking. 



NARRATOR: 



'*Thank you, Mr's. Cardova. Those are the 
spec'tal programs; Basic Education, Multl grade 
Hispartic Reading .Materials, Learning- C^nter^ 
and Indlvi'duajly Guided Mathematics Program . 
Spj^nd a few mlnutes studying the background 
on the CEVAL School and Community 1n the blue 
leaflet, as well as each o'f the programs as 
outlined with an eye to mak1r>,g decisions 
about what shouldj^be evaluated." 



Bing, pause * ' . 

Stop tape player 

Allow one ov t\^ minutes ^to study programe 



'Start tape 



iland out gveei^ aoneultant'a letter with the available aaeeeament 
information report while consultant is talking;. 

Bing, hing, bing^, pause 



EVALUATION 
CONSULTAt^T: 



"Yes. 1t*s all in the report. The 
letter expla 1 ns . wha t I've done. I 
up with an evaluatlon plan^ per se. 
done Is to'develop a list of tests 



covering 
didn't come 

What Tve 
, 1 ntervl ews 



surveys and other assessment activities which 
you, as principal, might want to undertake. I 
tfhlnk each one of the activities would yield 
useful information. The problem is, of course, 
Ahat if you tried to do all of the things I 
have .outlined he^re. you' wouldn't have time 
for anything else. So youWe got some decisions 
to make. I've tried to make them as easy as ^ 
possible by giving you an estimate of how 
many hours of your time each activity is likeJly 
to take, and preparing data tables which give 
you an idea of what the completed results 
will look like. 



I hope' this report is useful to you 
enjoyed working .at the school." 



7 



] I 



J^ARRATOft: *^Sp€nd a few minutes rej^lewlng the Evaluation 

Consultant's report .as It wilV^^^ve as the 
«bas 1 s for your evaluation." 



Blng^ pause • • 

Stop tape player 
Start tape f) laye r 
^ Bing , birig, bing , pause 



NARRATflR: 



\ 



"Assume that it 1s the beglvining of the school 
ye^r. You know that It 1 s poss 1 bl e t ha t the 
Superintendent or the board will ask you to 
prepare a report on qne or all of the programs 
at any time during the year. Yqu have also 
decided that you can afford no more tl>.an^5% 
of youi" time or 135 hours during the year on * 
evaluation/ Which of the five programs are 
you going to evaluate? Are you going to get 
a little 1 nf orrrfra t1 on on each pro'^gram, or 
^ evaluate one very th-oroughly? Hhat kind of 
information are you going to get? Select the 
assessment Information you want by circling 
the number of hours you want'on the wh i te 
shejet. Do not go over -135 hours, Y,ou have 
approximately. 20 minutes to make your selection 
Do this now." ^> * . 



S t o p t a p e p I a y er ^ • 

A I Lou appvoximat e.li^-P. 0 m-inutcs to select assessment instysi0ents 

Start tape player, hand out whi te As see sment Selection ^Form 

Hand out cream superintendent's^ merno while secretary is talking 
(see be low) ' . ' / 



Ping , h i 'n g , 
SECRETA^RY: 



' ' ^ , if 

"Hello, Ceval El emen tary School. Oh, hello, 
Mildred. No,, he didn't make it to th,^ board 
meeting last night. Can I take a message? 
"/(^pause) Basic Educati on parent s were upset. 
(^a^B though writing message ) .They w^nt Basic 
tdaeration in all the schools of the district. 
I ^s^^. The board wants a report on. the Ceva;V' 
experie^nce at Tuesday's meeting. A list of 
ques'tiuVs? OK, Til tell him. "ril expect 
them 'in''At.lie 1 n ter mail this afternoon. 

Thank>, -kindred , • \ 



NARRATCMR; "You should now have the questions the board 

wanjts answeited. Assume that you have access 
to all p-f.the data which you sel ected wl th 
your 135^ hours. Place two checks by each 
question you feel you would be able. to 
- answer well, one check by each que^stlon you 

could answer minimally, and'.a zero by each 
« ^ question which you would not be able to 

answer at all. D6 this now." 



Bing ) ' 

Turn tape player off .. 
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Clarifying Questions 



Why Is 1t called Ceval ? 

Ceval stands for California EVALuation project. 



How should the participants be divided at the beginning 
of the simulation? 

Before the< simulation begins, divide them Into groups of 
threes. If there 1s one "extra" person, form a four person 

group. If there are two "extra" persons, form a two person 

grojjp. Each group should have a table or desk on which 
tfi work. 



Should they be gl-ven warnings about how much time to use? 
Yes, give a 6, 5, 2, and 1 minute warning. 

Will they need more Instructions than are presented on 
the tape? 

Generally no, but you should be prepared to answer their 
questions. It Is probably best to answer each group's 
questions Individually rather than explain your answer 
to the entire group. 



What If they believe 5% of a principal's time Is unrealistic? 

We have surveyed several hundred principals and when asked 
how mfjch time they are likely to spend on evaluation, over 
75% of the participants answered 5%. 



Post-Game Discussion 



It Is possible for people to participate In a simulation 
such as this, believe that It Is very valuable and not be able 
to Identify what they learned or why they value It. The 
purpose of the discussion, and it Is the most important part 
of the experience, is to help the participants articulate the 
possible learnings which can be gleaned. from the simulation. 
Before moving to an abstract discussion of\concepts and ideas, 
however. It Is often necessary to give the participants a 
chance to express their immediate feelings, frustrations and 
impressions. One way to allow this to happen is to identify, 
the highest and 1 owest Sfior 1 ng group and ask them to describe 
the strategy they adopted in selecting their assessment 
instruments. As the two groups report, encourage the others > 
to expand, confirm, agree or disagree with what is being said. 
Then move from this to a more generalized discu-ssion by asking 
the participants to answer this question: "Anyone playing 
this game is likely to come to the following conclusions." 
You might have to give them a few examples and get them started. 
Once they begin, encourage them to list as many ideas as 
possible. The conce^pts listed below are likely to emerge: 



. Ai One should be aware of the relative cost of data. 

Bi One should take advantage of inexpensive data. 

C. One can learn a great deal about a program without 
conducting a giant research project. 

Di It is risky to rely on subjective evaluations. 

El It takes time to evaluate. 

F. There are many different reasons and uses for 
evaluative data. 

G. Parents, boards and teachers are all likely to be 
interested in different aspects of the educational 
program. 

Hi If one is going to do a better job of evaluating one 

probably will have to figure out a way tOfO^^t more time 

I, One has to decide how much a good evaluation is worth. 

J, One can be asked for an evaluation at any time. 

Ki Some programs need to be evaluated more than others. 



Please^ r(3tur^n at 
end of exercise 



Ceval Elementary School 
simulation exercise 
summary of rules and background information 

In this simulation you will be asked to: ' 

1. Identify programs to be evSiluated in the Ceval 
Elementary School 

2. Select*. the instrument's which will give you the 
information for your evaluation. 

3. Discuss and ana^lyze your choices. 



Description of Ceval Elementary School 



LOCATION: 

GRADES: 

NUMBER OF 
STUDENTS: 

PERSONNEL 



LANGUAGE 



RACIAL 
MAKE-UP 



VALUE OF 
HOMES IN 
area: 



A small unified school district in California 

K-6 



651 

Teachers : 22 

Volunteer Aides: 9 

Admi n i s tra tor : 1 

Non-certificated: 4 

2 2% Spanish speaking, English as a second 
1 anguage 

English speaking 

33% Chicano 
10% Blacks 
57% Caucasian 

30% below $20,000 

20% $21 ,000 to $35,000 

20% $36,000 to $44,000 

5% $55,000 to $80,000 

25% rent or lease 



Groups which Influence School Policy: 

Strong teachers' group which reviews and comments on all 
major policy decisions by administration and board. 

^PThe Evaluation Improvement Program 



Active parent advisory council with strong representation 
from Chicano Community . 

A 3-3 conservative liberal split on the board with one 
member who votes with either group depending on the issue. 

A press wh'i ch. features all controversy and considered by 
same to be hostile to the school and district. 

Three or four artlcuTate parents who are not members of 
any group, but make their influence felt whenever school 
policy affects their children. 



General Mood of Community: 

General demand for quality education at reduced cost. 
State, district and parents insisting on demonstrable 
achi evement . 



Results of State Testing Program: 

Ceval Elementary School is below the district in 
ma.themat1cs and reading at both the second and sixth 
grade level . 

■>» 

Special Programs ^t the Ceval Elementary School: 

Two years ago» a variety of programs were incorporated 
into the school to increase the effectiveness of the 
teaching process, ^ They include: 

• Basic Educa 1 1 on 

At each grade level, there is one basic education 
class.. All pupils are assigned by parent request.' 
Reading, writing, and ari thmetic are studied to the 
exclusion of all other subject matter including art, 
social studies., health, and current events. Discipline 
and formal manners are emphasized. Pupils stand when 
asking questions and shake hands with the teacher as 
they enter the room. All students are expected to do 
at least one hour of homework each evening. 



EKLC 



Learni ng Center 

The Learning Center is staffed by a full-time teacher 
who is supposed to work closely with all other members 
of'the staff. The focus of the Center is on individu- 



r 



' alized i nstructi ons' and s e 1 f -d i rec ted learning. Pupils 
work in groups and as i ndi v i dual s- on preassigned as 
well as self-selected proj.ects. The. purposes of the 
Center are t^: Ca) inc.i^ease the ability of pupi-ls to 
begin and coijvt)l ete, work independently, (b) to pro.vide 
1 earni ng -e^'er i ences which''would not normally te 
available in the regular classroom, (c) to increase 
the pupils' creativity and range of interests and 
(d) to make -it easier for the teacher to assign 
individual study projects. . . 

•Multigrades 

There are two mult i grade classes. ^One which combined 
grades 1 through 3 an d^ the second, grades 4 through 6. 
The -l-S class contains' 96 students, has 3*teacher5 
and 4 volunteer aides. The 4-6 class has 90 students, 
3 teachers and 2 volunteer aides. The purpose of the 
multigrades are to: (1) allow teachers to specialize 
in the teaeihing of subject areas and thus improve the 
academic excellence of the students, (2) increase the 
social and intellectual i nteracti on "of pupils across 
age groups, (3) increase the ability ofpupils to 
work independently, (4)'increase respect for stud.ents 
of different ages. 

• Reading Program for Bilingual Pupils 

A special reading program published by Hispanic Press 
has been instituted at the demand of a small group oT • 
Chicano parents. The main purposes are to in^crease 
the ability (of bilingual students to read English and 
to gain an appreciation and awareness of the C-hica no 
culture. -All teachers are requi.red to use tlj^ese 
materials with the Chicano students in their classruon- 

• Individually Guided Mathematics Prograrn 

A K-6 individually guided mathematics progratri built cm> 
the developmental concepts of Piaget and designed t<:) 
improve the mathematical excellence of the pupils. 
Used only in the multigrades. 



Some Reasons for Evaluating the Special Programs: 

None of these aforementioned programs have niandatgry 
evaluation requirements, however, there are good reason:^ 
for evaluat i,n g each of the special programs. 




Learning Center 



There is some disenchantment with the Learning Center. 
Some of the teachers have complained that the pupils 
*which .they send to the Center are not well supervised, 
that there is too much noise, dnd that the bpok,s and 
equ i pment a re not properly maihtained. Other teachers 
are wondering if the Center is used enough to justify 
the services of a f u 1 ' - 1 i m e t e dc h e r . 

Mul t1 grades 

The multigrade has been a controversial program since 
the beginning. There seems to be no "logical reason 
for the p6wer which the mere mention of the program 
has to polarize parents and teachers alike. There 
is l11<ely to be a battle over th-!"s program in so1ne 
form- or another sometime in the future, 

Reading Program for Bilingual Pupils 

The group of Chicano parents who persuaded the board 
to accept the Hispanic p r o g >^ a m U^T the C e v a 1 School 
has fallen out of .favor with Lhe rest ^of the Chicano 
community. The group who is now in power controls 
the Parent Advisory -Council and is reviewing all of 
the work by the former group and may put pressure 
on the board to abandon the Hisoanic reading program. 
It would be helpful if you and the board have an 
idea of the effectiveness of the program in order 
1 0 m a k e a wise decision. 



Individually Guided M a t h e in a t i c s Program 

Two members of the board are interested in getting 
individualized learning in math, science and reading 
established in the entire school and not just 
mathematics in the mu i t i g r'cul e s . It would be valuable 
to k n O'W how effective t ri e p >^ o i - a m is in the event 
the board calls for a t^epc)V't 

.Basic Educatior^ Pr^ogr\:i^^T / 

There is a move by the parpiii. who were instrumental 
in having the basic education classes put in th.e 
school .to convert the entire school to a basic 
education plan. It would be very helpful to know 
how the basic education p u p "i 1 s compare to other 
pupils in mathematics, w r i L 1 n g and reading a s.. we 1 1 
as in social studies, art, music and physical 
education in case they are successful in getting the ■ 
school b o\a r d to <: o n s i d o r" *: t; ■ m ) ■ , i,i u Q e s ti o n . 



Pleaee return at 
end of exerciee 



To: 



Re: 



Susan Greene, Principal 
CEVAL ELEMENTARY SCHOOL 

Possible evaluation activit-fes 



In preparing the enclosed report, I have listed a 
number of evaluation procedures which would yield useful 
and interesting data. Realizing that your time is limited, 
I have estimated the number of administrative hours which 
each procedure is likely to require. 

In addition, I have prepared tables for receiving the 
data of each evaluative procedure to help you visualize 
the kind of data each procedure will yield. 

I hope this information will be helpful as you deyelop 
your evaluation plan for the coming year. 

Sincerely , 



MARTIN WINSTON, Ph.D. 
Evaluation Consultant 
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The Evaluation Improv^nfient Program 



AVAILABLE 

ASSESSMENT 

INFORMATION 
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Standardized Tests: 

Reading 
Language 
Social Science 
Mathematics 
Science ^ ' 

Parent Questionnaire 

Staff Questionnaire 
\ 

Interview with Parents 



Summary of Pupil 
Observations 



Teacher Ratings of 
Pupils 



15 
15 
15 
15 
15 

35 

10 

25^ 

40 

20 



Teacher Logs 



Summary Sheet of 
Existing Records 
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95^ 



150 
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page 3 
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page 4 
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page 5 
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page 6 
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page 7 
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page 8 
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Sample of 
Sample of 



Parents 
Students 



standard i zed Tests 









Subject Area 
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\ -BASIC 
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1 


















2 


















3 


















^ 


















5 


















6 



















Format used for reporting scores for each of the norm 
referenced or criterion referenced tests, for example, 
reading scores, language scores. All scores are in 
percenti 1 e rank » 




Parent Questionnaire 
Table for Reparting Results 
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Tf^p. essence oY questions asked 
In Survey of Parents: 

1 I^rents' Teellngs about: 
Multlgr'sde 
Basic Education 

The Learning Center 

Hispanic Press Materials 

Individually Guided 
Mathematics 

2- Programs^ parents want 

extended to rest of district: 

Mul tigrade 
Basic Education 
The Learning Center 

Hispanic Press Materials 

Individually Guided 
Mathematics 

3. Parents' willingness to have 
child enrolled In: 

Multlgrade 
Basic Education 



Parents' willingness to have 
child use: 

The Learning Center 
Hispanic Press Materials 
Individually Guided 



Mathematics 



PERCENTAGE OF PARENT RESPONSES 


PARENTS OF' 
MULTIGRADE 


PARENTS 
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PARENTS 
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staff Questionnaire 
Table for Reporting Results 



PERCENTAGE OF STAFF RESPONSES 



The essence of the questions 
asked 1n Staff Questionnaire: 

1 . Staff J^lings about: 



2. 



The percent of staff 
reporting positive 
influence of programs on; 

Lwrning problems 

Discipline problems 

Parent's complaints 
t 

Student disinterest in 
school 



Clmri GRADE 


BASIC - 
■EDUCATION 


INDIVIDUALLY 
GUIDED ' 
MATHEMATICS 


LE 
CE 


^RNIN( 
UER 




HISPANK 
PRESS 




APPROVE 1 




NO OPINION 1 


APPROVE J 


DISAPPROVE. 1 


no'SpTnion 1 


' approve 1 
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^ NO OPINION 
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GUIDED 

MATHWTICS 


LEARNING 
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X, v-ontinued next year, what changes should be incorporated into programs? Each 
unique suggestion will be recorded along with the number of times the suggestion 
was tnade. 

Multigrade . ^ . ^ 



Basic Education . 

' 7 

Individually Guided Mathematics 



Learning Center 

^ ^ . . ^ — . 

Hispanic Press 



9k 



EKLC 



staff Interviews 
Table for Reportljrf' Results 



The essence of the questions 
asked 1n Interview with Parents! 

U Parents' feelings a bout i 

I. 

^ Multlgradfe 
Basic Education * 

The Learning Center 
Hispanic Press Materials 

Individually Guided 
Mathematics 

2. Parents* willingness to h^tve 
chtld enrolled in: 

Multi grade 
Basic Education 



Parents' willingness to have 
child use: 

The Learning Center 

Hispanic Press Materials 

Individually Guided 
Mathematics- : 



4. Progra^DS parents want extended 
to rest of district: 

* Multigrade 

Basic Education 

. • * \ 
■ ^Th^ Learning Center 

Hispanic Press Materials ^ 

PPIP" Individually Guided 
Mathematics • 



PERGENTAfeE OF PARENT ReIpON&ES ' 
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^upn Observations 
Table for Reporting Results 





STUDCNTS 
IN GRADeS 


HJLTIGRAQE 


BA3IC 
EDUCATION 


mjITlONAL 


GRADE ^* 
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POST' 


PRE 


POST 




POST 
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' Observations to be made; 

1. ^rcentage of time pupils observed In productive work. 
2^. Percentage of time pupils Interacted with other pupils. 

3. Percentage of time pupils worked 1n groups. ^ , 

4. Percentage of time pupHs spent 1n non-attendlnq to the assigned 
task. 

5. Number of times pupils disrupted class. 

6. Number of time/ pupils asked questions. 

7. Number of timis pupils Initiated learning. 



Teacher Rat Ings 
Table Used to Report Average Scores of Pupils 
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Ratings win be made on a five point scale wit^i a five meaning 
the pupil exhibits the behavior most of the tlitie.^and a one 
meaning the pupil almost never exhibits the behavior. 

1. Constructively cooperates with other pupils 

2. InUlateslearnlng 

3. Has a positive self-concept 
4 . Wo\rk s willingly. 

5. Exhibits creative behavior 



Teacher Logs 



Table used for reporting 
percentage of time spent 
teaching the following 
subjects: 

1. Reading 

Z. Mathematics 

3. Spelling 

4. Social Science 

5. Art 

6. Recreation 

7. Science 

8. Music 

9. language 



AU 

TEACHERS 


BASIC 
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MULTIGRADE 
TEACHERS 


TRADITIONAL 
TEACHERS 
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Summary Sheet of Existing Records 
Table for 'Reporting Results 



1 , Total number of absences 



2. Total number of books 
checked out or used at 
Learning Center 

3. Number of student vfslts 
to Learning Center 

4. Number QJP students referred 
to principal for discipline 



ALL 

CLASSES 



GRADE 



2^ 



BASIC 

EDUCATION 

CLASSES 



GRADE 



12 



MJLTI GRADE 
CUVSSES 



GRADE 



34 



56 



TRADITIONAL 
CLASSES 



GRADE 
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ASSESSMENT SELECTION FORM 



DIRECTIONS: Select the ^ 
assessment Information you 
1 want by circling the number 
of hours required to collect 
the Information. Do not 
select more than 135 hours. 
If you assess the entire 
stbool , then y% need not 
select any of tne subgroups 
on the same row as they are 
In the "Entire School" 
category 

■ > ■ 


Number of Hours To Assess 
Multi grade Classes — All 
Six Grades 


Number of Hours To Assess 
Basic Education — All Six 
Grades 


Number of Hours To Assess 
Spanish Surnamed Students 


Number of Hours To. Assess 
Traditional Classes — All 
Six Grades 


Number of Hours To Assess 
Entire School 


Types of Information 
Collected by Instrument 


1. Standardized Tests: 
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2. Parent Questionnaire 
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3. staff Questionnaire 
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4. Interview with Parents 
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5. Summary of Pupil 
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6. Teacher Ratings of 
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7. Teacher Logs 
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8. Summarv Sheet of 
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* Sample of Parents 
** Sample of Students 
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INTERDISTRICT MEMO 



% 



To: . Susan Greene, Principal, CEVAL ELEMENTARY SCHOOL 

From: Superintendent Hanson 

fRe: CEVAL EXPERIENCE WITH BASIC EDUCATION 



At last night's board meeting, a group of parents headed 
by Mrs, Baker accused the board of dragging Its feet on the 
question of providing Basic Education classes for all of the 
schools In the district. In response, the board asked for a 
report on the Ceval experience for the next board meeting. 
The question they asked was: What are the advantages and 
disadvantages of the Basic Education program as experienced 
by the Ceval Elementary School? I would think 1f you could 
answer the questions I have formulated below, that the board 
would be well satisfied. 



1. Do the Basic Education students make as much progress 
In reading as students who are not In Basic Education? 

2. In Mathematics? 

3. In Language Skills? 



5. In Social Studies? 

6. In Art and Music? 

7. Do the teachers of the school consider the Basic 
Education program worthwhile? 

8. Do the parents? 

9. Are the Basic Educ3tion students as innovative and 
creative as the other students? 

10. Are there any motivational problems associated with 
Basic Education? 

11. Do Basic Education students have more than their share 
of discipline problems? 



4. 



Sc 1 ence? 



PDHimk 
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Only one copy of the following four handouts is reproduced in this document. 



1/ Rules and Background Information 

2/ Evaluation Consultant's Report 
3/ Assessment Selection Form 
4/ Interdistrict Memo 



RULES 
AND 

BACKGROUND INFORMATION 



Please return at 
end of exercise 



. Ceval Elementary School 
simulation exercise 

SUMMARY OF RULES AND 6a'CKGR0UND INFORMATION 



In this simulation you will be asked to: 

1. Identify programs to be evaluated in the Ceval 
Elementary School 

2. Select the instruments which will give you the 
information for your evaluation. 

3. Discuss and analyze your choices. 



Description of Ceval Elementary School 

LOCATION: A small unified school district in California 
GRADES: K-6 

NUMBER OF 
.STUDENTS: 651 



PERSONNEL: 



LANGUAGE: 



RACIAL 
MAKE-UP: 



VALUE OF 
HOMES IN 

area: 



Teachers: 22 
Volunteer Aides: 9 
Administrator: 1 
Non-certi f i ca'ted : 4 

33% Spanish speaking, English as a second 
language 

67% English speaking 

33%Chicano 
10% Blapks 
57% Caucasian 

30% below $20,000 

20% $21 ,000 to $35 ,000 

20% $36,000 to $44,000 

5% $55,000 to $80,000 

25% rent or lease 



Groups which Influence School Policy: 

Strong teachers' group which reviews and comments on all 
major policy decisions by administration and board. 
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The Evaluation liiiprovemei|t;Pr,ogram 



Active parent advisory council with strong representation 
from Chicano Community, 

A 3-3 conservative liberal split. on the board with one 
member who votes with either group depending on the issue 

A press which features all controversy and considered by 
some to be hostile to the school and district- 
Three or f our agt Icul a te parents who are not members of 
any group, but make their influence felt whenever school 
policy affects their children. 



General Mood of Community: 

General demand for qu^ality education at reduced cost. 
State, district and parents insisting on demonstrable 
achievement. 



Results of State Testing Program: 

^ Ceval Elementary School is bel9W the district in 
mathematics and residing at both the second and sixth, 
grade 1 evel . 



Special Programs at the Ceval Elementary School: 

Two years ago, a variety of programs were incorporated 
into the school to increase the effectiveness of the 
teaching process^L They include: 

• ' .Basi c Education 

At each grade level, there is one basic education 
class. All pupils are assigned by' parent request, 
Reading, writing, and arithmetic are studied to the 
exclusion of all ot'her subject matter including art, , 
social studies, health, and current events, Dlsdplin 
and formal manners are emphasized. Pupils stand when 
asking questions andr shake hands with the teacher as 
they enter the room. All students are expected to do 
at least one hour of h-omev^ork each evening. 

• Learning Center 

The Learning Center 'is staffed by a full-time teacher 
who is supposed to work closely with all other members 
of the staff. The focus of the Center 1s on individu- 



allzed Instructions and s el f -dl rect ed learning. Pupils 
work In groups and as Individuals oh preasslgned as' 
we 11 as self-selected projects. The pur poses of the 
Center are to: (a) Increase the ability of pupils to 
begin and complete work Independently, (b) to provide 
learning experiences which would^ not normally be 
available in the regular classroom, (c) to increase 
the pupils' creativity and range of interests and 
(d) to make It easier for the teacher to assign 
Individual study projects . 

• Multlgrades 

There are two multlgrade classes. One which combined 
grades 1 throughSand the second, grades 4 through 6. 
The 1-3 class contains 96 students, has 3 teachers 
and 4 volunteer aides. The 4-6 class has 90 students, 
-3 teachers and 2 vol un teer a1 des . The purpose of the 
multlgrades are to: (1) al 1 ow teac hers to specialize 
In the teaching of subject areas and thus improve the 
academic excellence of the student si (2)increase the 
social and Intellectual interaction of pupils across 
age groups, (3) increase the ability of pOpils to 
work '1 ndependen tl y , (4) Increase respect for students , 
of d i f f erent ages . 

• Reading Program for Bilingual Pupils^ 

A special reading program published by H4spanic Press 
has been instituted at the demand of a smal T'^^roup of 
Chicano parents. The. main purpo^ses are to Increase 
the abl 1 1 ty of. btl i ngual students to read English and 
to gain an appreciation and awareness of the Chicano 
culture. . All .teachers are required to use these 
materials with the Chicano students in their classrooms 

• Individually Guided Mathemati cs Program 

A K-6 individually guided mathematics program built on 
the developmental concepts of Piaget and designed to 
improve the mathematical excellence of the pupils. 
Used only in the multlgrades. ^ - 

Some Reas'ons for Evaluating the Special Programs: 

None of these af brement ioned programs have mandatory 
evaluation requirements, however, t:here are good reasons 
for evaluating each of the spec i al programs . 
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Learning Center 

There 1s some disenchantment with the Learning Center. 
Some of the teachers have complained that the pupils 
which they send to the Center are not well supervised, 
that there Is too much noise, and that the books and 
equipment are not properly maintained. Other teachers 
are wondering 1f the Center is used enough to justify 
the services of a full-time teacher. 

Multlgrades 

The mufltlgrade has been a controversial program since 
the beginning. There seems to be no logical reason 
for the power which the mere m^ntlo.n of the program 
has to polarize parents and teachers alike. There 
Is likely to be a battle over this program in some 
form or another sometime in 1;,he future- 
Reading Program for Bilingual Pupils 

The group of Chicano parents who persuaded the' board 
to accept the Hispanic program for the Ceval School 
has fallen out of favor with the rest of the Chicano 
community. The group who is now in power controls 
the Parent Advisory Council and Is rev1 ew1 h^g al 1 of 
the work by the former group and may put pressure 
on the board to abandon the Hispanic reading program. 
It would be helpful if you and the. board have an 
idea ofthe effectiveness of the program in order 
to make a wise decision. 

Individually Guided Mathematics Program 

Two members of the board are interested in getting 
individualized learning in math, sci^ence and reading 
established in the entire school, and not just 
mathematics in the multlgrades. It would be valuable 
to know how effective the program is in the event 
the board calls for a report. 

Basic Education Program 

There is a move by the parents who were instrumental 
in having the basic educationclasses put inthe 
school to convert the entire school to a'basic 
education plan. It would be very helpful to know 
how the basic education pupils compare to other 
pupils in mathematics, writing and reading as wel 1 
as in social studies, art, music and physical 
education in case they are successful in getting the 
school board to consider their suggestion. 



EVALUATION 
CONSULTANT'S 
REPORT 
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Pleaee return at' 
end of exercise 



\ 



Tt: Susan Greene, Principal 
CEVAL ELEMENTARY SCHOOL 

Re: Possible evaluation activities 



In preparing the enclosed report, I have listed a 
number of evaluation procedures which would yield useful 
and Interesting data. Realizing that your time 1s limited, 
I have estimated the number of administrative hours which 
each procedure is likely to require. 

In addition, I have prepared tables for receiving the 
data of each evaluative procedure to help you visualize 
the kind of data each procedure win yield. 

I hope this Information will be helpful as you develop 
your evaluation plan for the coming year. 

Si ncerel y , 



MARTIN WINSTON, Ph.D. 
Evaluation Consultant 
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-AVAILABLE 
ASSESSMENT 
. INFORMATION 


Number of Hours To Assess 
Multigrade Classes — All 
Six Grades 


Number of Hours To Assess 
Basic Education r- All Six 
Grades 


Number of Hours To Assess 
Spanish Surnamed Students" 


Number of Hours To Assess 
Traditional Classes -- All 
Six Grades 


Number of Hours To Assess 
Entire School 


Types of Information Collected 
by Instrument * ^ ■ 
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Summary of Pupil 
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Summary Sheet of 
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ERJC ** Sample of Students 



standardized Tests 



Subject Area . . ^ ^ 
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Forma:t us^ld for reporting scores for each of the norm 
referen'Cfed or criterion referenced tests, for example, 
reading scores, language scores. All scores are 1n 
percentile rank. 
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Parent Questionnaire' 
Table for Reporting Result^ 



The essence of questions asked 
In Survey of Parents: 

1. Parents' feelings about: 
Multlgrade 

Basic Education 

The Learning Center 

Hispanic Press Materials 

Individually Guided 
Mathematics j 

2. Programs parents want 
extended to rest of district: 

Multlgrade 
Basic Education 
The Learning Center 

Hispanic Press Materials 

Individually Guided 
• Mathematics 

3. Parents* willingness to have 
child enrolled In: 

f^ltlgrade 
Basic Education 

W Parents* willingness to have 
child use: 

The Lear^nlng Center 
Hfspanic Press Materials 



Q Ind.1v1dua>lly Guided 
Mathematics 



PERCENTAGE OF PARENT RESPONSES 
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staff questionnaire. 
Table for Reporting Results 



PERCENTAGE OF STAFF RESPONSES 



The essence of the questions 
asked In Staff^uestlonn&lre: 

1. Staff feelings about: 
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CENTER 




HI 
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NO OPINION 1 
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2. The percent of staff 
reporting poslt'lve 
, Influence of programs on; 

Learning problems ■ 

Discipline problems 

Parent's complaints 

Student disinterest In 
school 
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If continued next year, what changes should be Incorporated into, programs? Each 
unique suggestion will be recorded along with the number of times the suggestion 
was made. 

Multlgrade - : ^_ ' - / ' 



Basic Education 



Indlviduany' Guided Mathematics 



staff Interviews 
Table for Reporting Results 



The essence of the questions 
asked in 'interview with Parents: 

1. Parents' feelings about: 

Multi grade 
Basic Education 

The Learning Center 
^Hispanic Press Materials 

Individually Guided 
Mathematics 

2* Parents' willingness to have 
child enrolled in: 

Multi grade 
Basic Education 



3. Parents' willingness to have 
child use: 

The Learning Center 

Hispanic Press Materials 

Individually Guided 
Mathematics 

4. Programs parents want extended 
to rest of district: 

Mul tigrade 
Basic Education 

The Learning Center 

Hispanic Press Materials 

Q Individually Guided 
ERIC Mathematics 
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Pupil Observations 
Table for Reporting Results 
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Observations to be made: ^ 

1. Percentage of time pupils observed In productive work. 

2. Percentage of time pupils Interacted with other pupils. 

3. Percentage of time pupils worked In groups. 

4. Percentage of time pupils spent In non-attending to the assigned 
task. 

5. Number of times pupils disrupted class. 

6. Number of times pupils asked questions. 

7. Number of times pupils Initiated learning. 



Teacher Ratings 
Table Used to Report Average Scores of Pupils 
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Ratings will be made on a five point scale with a five meaning 
the pupil exhibits the behavior most of the time, and a one 
meaning the pupil almost never exhibits the behavior. 

1. Constructively cooperates with other pupils 

2. Initiates learning 

3. Has a positive self-concept 

4. Workswilllngly. 

5. Exhibits creative behavior 



Teacher Logs 
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Summary Sheet of Existing Records 
Table for Reporting Results 
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Learning Center 
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Number of student visits 
to Learning Center 


















































4. 


Number of students referred 
to principal for discipline 
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ASSESSMENT SEL£CTION FORM 



DIRECTIONS: Select the 
assessment Information you 
want by circling the number 
of hours required to collect 
the Information. Do not 
select more than 135 hours. 
If you assess the entire 
school , then you need not 
select any of the subgroups 
on the same row as they are 
In the "Entire School" 
category 


Number of Hours To Assess 
Multigrade Classes — All 
Six Grades 


Number of Hours To Assess 
Basic Education — All Six 
Grades ^ 


Number of Hours To Assess 
Spanish Surnamed Students 
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Traditional Classes — All 
Six Grades 
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Types of Information 
Collected by Instrument 
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The Evaluation improvement Program 



ASSESSMENT SELECTION FORM 



DIRECTIONS: Select the 
assessment Information you 
want by circling- the number 
of hours required to collect 
the Information. Do not 
select more than 135 hoijrs. 
If you assess the entire . 
school , then you need not 
select any of the subgroups 
on .the same row as they are 
In the "Entire School" 
category 


Number of Hours To Assess.' 
Multlgrade Classes — All ' 
Six Grades 
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Basic Education — All Six . 
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ASSESSMENT SELECTION FORM' 



DIRECTIONS: Select the 
assessment Infonnatlon you 
want by circling* the number 
of hours required to collect 
the Information. Do not 
select more than 135 hours. 
If you assess the entire 
school , then you need not 
select any of the subgroups . 
on the same row as they are 
In the "Entire School" 
category 


Number of Hours To' Assess 
Multl grade Classes — All 
Six Grades 


Number of Hours To Assess 
Basic Education — All Six 
Grades 


Number of Hours To Assess 
. Spanish Surnamed Students 


Number of Hours To Assess 
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Six Grades 
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Entire School 
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, Collected by Instrument 


1. Standardized Tests: 
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The Evaluation Improvement Program 



INTERDISTRICT 
riEMO 



DUPLICATE ADDITIONAL SUPPLIES ON CREAM WHEN SUPPLY GETS LOW; 

n. V.-. '' ■.(■.■M- 



INTERDISTRICT MEMO 



To: Susan Greene. Principal. C£VAL ELEMB^^TARY SCHOOL 
From: Superintendent Hanson 



At last night's board meeting, a group of parents headed 
by Mrs. Baker accused the board of dragging its feet on the 
question oX providing Basic Education classes for all of the 
schools in the district. In response, the board asked for a 
report on the Ceval experience for the next board meeting. 
The question they asked was: What are the advantages and 
disadvantages of the Basic Education program as experienced 
by .the Ceval Elementary School? I would think 1f you could 
answer the questions I have formulated below, that the board 
would be well satisfied. 



1 . 


Do 
i n 


th'e Basic Educa t^j on 
reading as students 


students make as much progjj 
who are not in Basic Educa" 


ress 

:ion?' 


2. 


In 


Mathemati cs ? 






3. 


In 


Language Skills? 






4. 


In 


Science? 






5. 


In 


Social Studies? 






6. 


In 


Art and Music? 






7. 


Do 


the teachers of the 


sc hool'^cons i der the Basic 





Education program worthwhile? 

8 . Do the parents ? 

9. Are the Basic Education students as innovative and 
creative as the other students? 



10. Are there any motivational problems associated with 
Basic Education? 



Re: 



CEVAL EXPERIENCE WITH BASIC EDUCATION 




1 1 . 




Do B|isic Education students have more than their share 
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Tl^ Evaluation Improv^itient Program 



